A SURVEY OF ALLOCATION MODELS 
IN 

SEARCH THEORY 



by 



Brian David Engier 




Thl6 document hcu> been approved fan public ne- 
lecu>e and tale ; lt& dlit/ilbution h> unlimited. 



1.135681 



RY 

POSTGRADUATE SCHOOE 
REY, CALIF. 93940 



A Survey of Allocation Models 
in 

Search Theory 



by 



Brian David^Engler 

Lieutenant (junior grade). United States Navy 
B.S., United States Naval Acadeny, 1969 



Submitted in partial fulfillment of the 
requirements for the degree of 



MASTER OF SCIENCE IN OPERATIONS RESEARCH 



from the 

NAVAL POSTGRADUATE SCHOOL 
September 1970 



ABSTRACT 



The problem of optimally allocating available efforts to search 
for an object at sea comprises a major class of problems in naval 
warfare. This thesis presents in some detail Koopman's classic two- 
region and continuous search models, along with the n-region discrete 
model which provides some continuity between the two. Brief summaries 
of four of the more important extensions to the basic theory are also 
included. 
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I. INTRODUCTION 



A major class of problems in naval warfare consists of those 
involving the search for an object at sea, the position of which is 
unknown but is distributed in accordance with a known law of 
probability. The question of interest to this thesis is how to 
allocate available resources (or effort) in a search of this type, 
as for an enemy submarine or a downed pilot. 

Early research was done by B. 0. Koopman who, in 1946, wrote 
up the results of studies performed by what would later be known as 
the Operations Evaluation Group (OEG) of the United States Navy [5]. 
His models continue to be the basis for further studies into search 
theory, and it is, therefore, natural to begin any paper on allocation 
of searching effort with a derivation of Koopman's original model. 
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II. KOOPMAN'S TWO- REGION MODEL 



Koopman began the study of search effort distribution with the 

i 

simplest case: consider two areas in either one of which an object 

may be located with a certain probability. The initial assumption 
to be made in this situation is that the random search model will 
be used to describe the search, regardless of the actu?l searching 
pattern used. This is a conservative yet realistic assumption since, 
practically speaking, any search, regardless how systematic, has a 
certain amount of randomness inherent in it due to navigational and 
other errors. The results obtained using this model are fairly 
simple and require no further assumptions concerning the particular 
detection law except for the observer's sweep width. 

A review of the development of the random search model is an 
essential basis for a full understanding of Koopman's development. 

A. DEVELOPMENT OF THE RANDOM SEARCH MODEL 

It is assumed that the stationary target is equally as likely 
to be in any one location within the given search region of area A 
as in any other (i.e., the target is uniformly distributed in A). 

It is assumed, further, that the searcher has no set plan for 
observation. 

Several definitions are necessary at this point: 

F(X). . . the lateral ranae for a certain observer and target in 
the existing environmental conditions. It is a graph- 
ical representation of the cumulative probability of 
detecting a single target passing at some lateral range, 
X, from a particular detection device under given 
environmental conditions. 

L. . . the path lengih of the observer in A, which is divided 

into N equal segments each approximating a straight line. 
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L/N . . . the length of each of the N path segments. By the 
random search assumption, each is independent. 



i W . 



the sweep width of the observer, equal to the area 
under the lateral range curve. ^ t*) 



Rm. . . the maximum lateral range from the observer at which 
the target is detectable. 

Let: event A be the event that the target is in area A, 

event B be the event that the target is detectable 
along any segment L/N (i.e., that it lies within the 
area L/Nx2Rm) 

event C be the event that the_target is detected 
along the segment L/N. Then C is the event that it 
is not detected along L/N. 

event_D be the event that the target is detected. 
Then D is the event of non- detection. 

It is to be understood that event A is a condition throughout 



the following: 



W—T 

P(c|d)= ELF<*y] 




w 

* 2 R>fn 



Thus, 



And, 



P(C> - 

PVc) = 



P(CI6} • P(B) = 

\- — 

’ WA 

( WU\ W W JU. 0 ” Nfl) 

0“^) =e 



When (^) is small. 



which is most often the case: 




VL 
N A 
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[Equation 1] 




and finally. 



_v/L 

l-e * 



At this point, the condition on event A has been inserted for 
a reason which will soon be evident. 

One final assumption which should be noted is that 2Rm<<L/N, 
thus permitting the overlap of segments to be disregarded . 

Ml 

The expression ~K~ is called the coverage factor, and measures 
the amount of effort expended in searching the area A. 

It should be noted that by the very nature of the observer's 
random path selection, the probability of detecting a target within 
a certain area. A, given that it is in area A, will approach, but 
never quite equal, one. In other words, the observer can never be 
certain of entirely covering A with the 2Rm-wide swath of coverage 
he is cutting out along his search path L, due to the possibility 
of crossing an area already searched. 

B. DERIVATION OF THE TWO-REGION MODEL 

In Koopman's simplest model it is known that: 

(1) A target is located within one of two regions of areas 
A.| and A2 with probabilities p-j and p 2 respectively, 

where: + p 2 = 1, p-|>0, p 2 >0. 

(2) The target is stationary, which implies p, and p ? are 

constant. c 
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(3) The target has a uniform distribution in whichever 
region it is located. 

(4) L, which is the observer's total path or track length 

is such that: L=L^ +l.2> where L-j and L> are the track 

lengths in and 

A good measure of effort available is the length of track along 
which the observer can search. Since a maximum L exists and is 
known, the problem to which this model should provide an answer can 
be stated as: What is the best, or optimal, distribution of L 

between A-j and such that the chance of detecting the target is 
as large as possible? 

Using the events A and D defined previously, it is a fact that: 

P(^ = ?(&} ' PUIR) 



In the two region model: 



p-j = P(target is in A^) 
P2 = P(target is in A2) 



and the random search equation becomes: 

P(di a, 1 ) = \ - e 
P(di * 1 - e ^ 

Thus, the mathematical statement of the problem is as follows: 
maximize P(D)~p, \l-e / + 






subject to: 



+ \- a 

L , * O , L ,»0 



The objective function may 



P( o') = fl - p,e 757 + 

- f.tp.-p.e 75 ' 



“ U 






— v*jL jl 






Thus 



_wl, -wh 

, F(D> = \- p,e 81 - P A e [Equation 2] 

i 1 

Letting L^=x and L 2 =L-L^=L-x, for simplicity, the maximization 

of [Equation 2] can be converted to an equivalent minimization 

problem, namely: -Wx - Yf(L 

minimize 4 ( ?0 = f » £ ^ 

subject to: O ^ “X ^ L 

This problem may be solved both graphically and analytically, 

* 

the latter of which will be followed in this thesis, though using 
a method somewhat different from Koopman's, since graphs soon become 
useless when the model is extended beyond two regions. Koopman's 
graphical solution is useful, however, as an aid to understanding 
just what needs to be done in optimizing the allocation of search 
track as a measure of searching effort in this simple case, and may 
be found in reference [5]. 

In order to solve this minimization problem using the Lagrangian 

approach, the inequality constraint must first be gotten rid of. 

2 

This can be accomplished by letting x=u and adding a slack variable, 
so that the problem becomes: 

- Wu* - VOCl-h*) 
minimize 4 (^ a ) = f,e A ' + p e 

subject to: s* - 

The Lagrangian function is: 

« iUV Ml-* 1 -,*) 
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For which the following necessary conditions must hold at a 



stationary point: 




(2) I =Ak = = O 5^-0 




— ("f (w 1 ) ~ ~ ^ 



From (2), if s^O, then X=0, and from (3), uf'(u^)=0. This in 



turn implies that either u=0 (x=0), or f ' (u^)=f' (x)=0. 

2 

Again from (2), it might be that s=0. Then from (1), u =x=L. 



Hence, there are three cases to be examined: 

Minimum at (a) x-0 ^f' (x-O)^O 

(b) x=L^f' (x-L) ^ 0 

(c) x 5 f ' (x)=0 

These cases may be visualized most readily be referring to 
Koopman's graphical approach in [5]. 



Case (a): if 3 a minimum at x=0 M ' (0)^-0 (the curve depicting 

f(x) can slope upward or be level for any x^[0, L] as x goes from 



Since, r -no tjt + p. e PT 



vo % — voCLj^) 




0 to L). 



- w-o 






Now, 



= - ^ p + 

a, r» + 



A, 1» 
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>o 



or. 



A fi e ^ a, P. 



Thus, 



- WL 

K e 



> ±- 

* ft. 



[Equation 3] 



Case (b): if 3 a minimum at x=L^f'(L)4 0. 



By a similar exercise: 

~ _wl _ 

Xl p A » N. Xi 

Ai " Ax 



[Equation 4] 



Case (c): if 3 a minimum at x 3 f'(x)=0, this value of x must 

be found. 



Let . w w -VXL^ 

f W = “s ?' e +x = o 



In this equation 

e si" « e 



■ft 



By transposing, 

Ax C 



- y>«- VJ-x 

^ .^TST 



“ Av 



. , - Ha 

e n. 



or. 



„Wl 



1 ^ p n J. = 1 » £ 

Ax Ai 



P - V»J X _ VOx 

M p Al . p A), 



Note that, 






_ W* 

"KL 



-vo 

= e. = e 



12 



Taking the natural log of both sides, 

nr + 

1 

Multiplying both sides by W and transposing yields: 

\ A) A/. / Ax W A, V Ax 
In this equation. 



JL 

W 



\Aa7 * ■ "w* ‘ fcf) 



Therefore, in the case where f'(x)=0, the minimum value of 
f(x) is at: 

9C 



-* (illAi \ ( — + — -£a- Ax\ 

\A, tAj./ \ ^x W Ai J 



or. 



\ ( ft, .M* o ?. Ax\ 



[Equation 5] 



It is obvious from the above equations that there exists one 
point, x, in the interval [0, L] which minimizes f(x) and in turn 
maximizes P(D) subject to the constraints on track ler.gth. 

Perhaps more irportant, however, note that [Equation 3] and 
[Equation 4] set down threshold values for and ^ , which, 
following Koopman's example, will be defined as the probability 
densities for the two regions, and labeled and £ , respectively 






These values, then, are such that unless ^ exceeds the value A 

all searching effort should be concentrated in Ap, and likewise, 
if ^ » Ap should be ignored and all effort sent to A^. 
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At this point, a final simplification of notation is necessary 
in order to clarify the preceding argument. Note that a better 
measure of searching effort than merely the observer's track length, 
L |t> in area , is the area swept within that region, or WL^ . Thus 
the expressions: 



WU> 

A. 






0 _. • — ' Qi — » 

i * A. » 

are defined by Koopman as the density of search effort in the two 

regions. Finally, the total searching effort will be defined as 

follows for the two- region case: 



WLi 



<| - A 4 ■+ = W ( * WL 



where (J-j, and the total area is A=A-|+ ^ 

In summary, then, for the two-region search model, if: 

— ^ 

^ ^ ^ C [Equation 3'] 

then all searching effort should be confined to A2. Cve. L^-L) . 



If: 



e A 4 e, e 



-<a, 



[Equation 4'] 



then all effort should be concentrated in A^. ( i.e. L, S L) 
If however, 

e,->^ e e x =-e,e 



[Equation 5] holds. So, by replacing x by L-j, and by use of the 
preceding simpler and more meaningful definitions, the optimal 
distribution of search effort between the regions may be obtained as 
follows: 



"X ® 
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Substituting, 

= 7T -TCT 



w 



Multiplying both sides by TTj", 



VH-i _ VJL jU 
A V A 



C-Qv, ^ 



Noting that A 2 =A-A^ and substituting, 

+ ^ t< A -P.) -*»<>, " 

Finally, 



0, + -|L 

[Equation 5'] 



and similarly, 

(AAe, 4 



^ 0 



§ 



4 



A 



Equations 3’, 4', and 5' are the results Koopman 
his study of a simple two-region searching situation, 
upon which most further work by Koopman and others in 
is based. 



obtained in 
and those 
search theory 
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III. AN n-REGION DISCRETE MODEL 



The two- region search model can be fairly readily extended to 

i 

a situation involving n regions. Seme previous definitions can 

be modified as follows: 

Aj. . . area of the ^th region 

L. . . . length of the observer's track in A.. 

P.j. . . probability that the target is in A^ . 

Still assuming that the search is random, the probability of 
detection becomes: 

-v _VoLi.\ — volt 

-\-2 

t=. 

and the n-region problem may be stated as: 

maximize ~ ^ 

subject to: ~L 

l_- t ^ O ■$*»' , • • • »' rv 

This should be compared with the mathematical statement of the 
two- region problem. 

By an argument analogous to that in the two-region case, it 
becomes obvious that either all the available searching effort ($) 
is divided up among all of the n regions, or there exists some sort 
of threshold value for each region below which no effort should be 
expended in that region. So, Kuhn-Tucker conditions are applied 
to the problem: 

rv -wl; 

minimize 21 Pi e 1 
l=i 

subject to: L t = L 

«•=» . 

Li ^ ° ^ ^ 
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or, letting as before: 



minimize 



£(*) - 



rv 

I f^e ^ 

t=i 



subject to: XL 

i = ' «, . _ I ^ 

^Xj O nc>^ 1 - 1 1 i “ 



v% 



The technique for solving this problem by using the Kuhn-Tucker 

conditions is set forth in [13], and it is sufficient to the purpose 

of this paper that only a brief mention be made of the method. 

A solution to the minimization problem above is obtained by 

finding a saddle point of its Lagrangian, 

a _yj»; ■ / a \ 

L (•»,>') = E - Mx-£»0 

* c-l 1 



In other words, by finding x* and X* such that, 

L U,y ) « LU*,V) < L(.-x*,X) 

Necessary conditions for th. existence of such a point were 
found by Kuhn and Tucker to be: 

L 5 > o , = o , * 

also, 

L 5 -4o , xL^=c. ) ^»o 




) 



For the problem at hand, with convex objective function and concave 
constraints, these conditions are also sufficient. 



17 



The solution of these conditions for the problem stated above 

gives the following results for the amount of effort to be expended 

! 

in any region, i. 

Letting J* = maximum P(D), there exists a dual variable 

^ = AZ. > o 

b'* such that: 



(a) if X < * 

< b ) if ' ! jfr ^ X 



, then x.j = 0 
, then x. = v * A V 



v p; 

Note that xis the threshold value of '~KT , which equals , 

to be more consistent with prior notation, below which no effort is 
to be expended in region i. 
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IV. A CONTINUOUS MODEL 



It is a simple step from the n-region discrete model to a 



continuous one; n will be permitted to increase without bound, hence 
each Aj approaches zero in the limit. Again, some modification of 
previous notation is necessary: 



Ai, = ZV* Ay » since it represents a two-dimensional area. 

As a consequence of the breaking down of the notation into one- 
dimensional quantities, the subscripts which previously denoted areas 
are inconsistent and will be replaced by double subscripts, ear.h 
representing a component in either the x or y direi ..ion the two- 
dimensional Cartesian coordinate system. Hence, each of the following 
identities is defined: 



where the single subscript, denoting a region, is not to be confused 
with the first letter of the double subscript, denoting only the 
x direction. 

The continuous problem, then, is derived as follows: 




fij 3 

<*Ci = 0 l , as defined above. 




- // 0 - e ** 



where: p'x.y) is the joint probability density, and 



0(x } y) is the density of searching effort. 
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A mathematical statement of the continuous problem is: 

maximize j j ( \ ~ cVm 

0 U, •j) 

subject to: ] T 0 Cx.^1 cUj = (|> 

0 b^) Y*^ 

This problem was originally treated by Koopman in [5] as a 
problem in calculus of variations. Since 1946, however, new 
mathematical methods have evolved which can be used in this case. 

In a report by J. Taylor [11], Koopman’s problem is solved by the 
Pontriagin Maximum Principle. 

Consider, for clarity, the one-dimensional continuous problem: 

maximize \ P(>l(l-e W 
PU) -U J, 

subject to: j &(■*) <^/x = $ 

0(*xl ^>0 V* 

Note that the two-dimensicv . } problem which has been considered 
up to this point, may be treated in the same manner, though the 
details become complicated, so nothing is lost in considering the 
latter. 

In order to derive a solution to the above problem by the 
maximum principle, an equivalent problem must be formulated. Defining 
a new state variable, y(x), equal to the cumulative search effort 
expended for X <x: 

X 

ci (tO) =■ ^ 0(*x)ck* 

J — oO 
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the problem becomes: _ . . 

f ( \ . 

. . \ p<>) \ \ ~ ^ < 

maximize j \ 

<pcA 

ii. - 0 (tC) 
subject to: A* 

where 0(x) 2*0, 

and y(x= -»)=0, y(x= +«)= $ 

The solution is, briefly, as follows: 

the Hamiltonian is: 

> cSO °') ~ )+^ 0O ° 
and J* is defined as in the n-dimensional case: 



J*= *°°) A* 

*** — ° S3 ^ 

Thus the dual variable = O, since y(x) is the cumulative 



search effort, and since by expending more than the optimum effort, 
the maximum P(D) can o f *ly be decreased. Note that X(x) is a constant 
since 



cQ(*) _ _ __ Q 

“ C>*j 

The proolem now becomes: 



maxi mi ze 



subject to: 0(-x) ^ O 

which is simplified by letting A= -u where u>0. 



By applying the necessary and sufficient conditions: 

(a) 0(x)=O when ^ 

(b) 0(x)>O determined by oT = ? cv ^ - va. - O 

V-U 

when e. <0 V*,# . 



The optimal distribution of searching effort is found to be 
dependent upon a threshold value oi p(x) called u>0 such that: 

(1) for p(x)<u, 0(x)=O 

/ r<»i \ 

(2) for p(x)^-u, 0(x)= Jnl uJ. 
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u is chosen such that: 



where u is determined as follows: 

Defining _Q. = { -x | pt*) ^ u*"} , 

J JU (^r)cVx = j 0(^<^x = $ 



The three basic models for the allocation of searching effort 
have now been described in some detail. The two- dimensional discrete 
and the continuous models were originally formulated by Koopman 
in 1946, while the n-dimensional discrete case simply provides an 
easy passage between the two. As stated previously, numerous 
extensions of Koopman's basic models have been derived since his 
original paper, and brief descriptions of some of the more important 
of these will occupy the remainder of this thesis. 
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V. SOfC EXTENSIONS TO THE BASIC THEORY 



A. CHARNES AND COOPER, 1958 



Chames and Cooper state the objective of showing that search 
theory and mathematical programming can be combined to treat 
broader classes of operations research problems. 

Koopman's discrete allocation problem is treated as a problem 
in convex programming, the solution of which is obtained by 
application of the Kuhn-Tucker conditions, and a note is made on 
the extension of this method to the continuous case. 

The Chames and Cooper model is an important contribution to 
search theory in that the algorithm is solvable by computer. 

B. DE GUENIN, 1961 

De Guenin generalized the Koop ian ridels by developing an 
algorithm in which no assumption is maae regarding the detection 
probability function since, as he points out, while the assumption 
of the negative exponential (random search) function is adequate for 
military search problems, there are numerous non-military applica- 
tions of search theory, such as mine prospecting or oil exploration, 
where this is invalid. 

De Guenin, then, expresses the probability of detection as a 
function of the density of search effort, that is and the 

generalized problem becomes: 



maximize 
subject to: 





0 > o V a 
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where: P is defined to be the overall probability of success of the 

search, and g(x) is to be identified with p(x) in Koopman's continuous 
model. Necessary conditions for the optimal distribution of searching 
effort are developed by a finite difference approach, although today 
the problem may be solved by a routine application of the Pontriagin 
Maximum Principle [11]. 

C. DOBBIE, 1963 

Dobbie developed sufficient conditions for the additive property 
of the optimal distribution of search effort noted by Koopman in 1946. 
That is, the property that the distribution of effort, call it 0*(x), 
which maximizes the detection probability with a given amount of 
effort, ^ , is in fact the sum of the optimal distribution of some 
part of the effort, E-j , and of the conditionally optimal distribution 
of the remaining effort, E2, given that the larget has not been 
found with Ej. The author then derives the optimal distribution 
working from this property, which is, in fact, nothing more than the 
Principle of Optimality from Dynamic Programming. 

D. POLLOCK, 1964 

Pollock presents a Bayesian approach to the problem of allocating 
search effort. Decisions are made in a sequential manner, depending on 
what has been observed up until that time. He has determined the 
optimal sequential strategies for a two- region discrete model. In 
Koopman's original report, [5], it is interesting to note that he had 
shwon nothing was to be gained by such an approach since, in the two- 
region search, if additional effort, ^ , is added to $ after the 
search has failed to detect the target, and if this $ is distributed 
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optimally between A-j and A^, the total effort applied to the two 
regions is 0-j + and 0 2 + 0 2> respectively, which by use of 

j 

[Equation 5'] reduce to precisely the same values they would have been 
had the original effort been $ + $ with no prior knowledge of 
search results. 
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VI. CONCLUSIONS 

The purpose of this thesis has been to bring together under a 
single cover the classic models for determining the optimal allocation 
of searching effort, and to give a very brief description of several 
of the more important recent developments in search theory. An 
excellent listing of further published works dealing with the 
allocation of searching effort can be found in reference [3]. 
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